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Abstract —In this paper, we propose a noisy network cod¬ 
ing integrated with partial decode-and-forward relaying for 
single-source multicast discrete memoryless networks (DMN’s). 
Our coding scheme generalizes the partlal-decode-compress- 
and-forward scheme (Theorem 7) hy Cover and El Gamal. 
This is the first time the theorem is generalized for DMN’s 
such that each relay performs both partial decode-and-forward 
and compress-and-forward simultaneously. Our coding scheme 
simultaneously generalizes both noisy network coding by Lim, 
Kim, El Gamal, and Chung and distributed decode-and-forward 
by Lim, Kim, and Kim. It is not trivial to combine the two 
schemes because of inherent incompatibility in their encoding 
and decoding strategies. We solve this problem by sending the 
same long message over multiple blocks at the source and at 
the same time by letting the source find the auxiliary covering 
indices that carry information about the message simultaneously 
over all blocks. 

Index Terms —Noisy network coding, distributed decode-and- 
forward, unified coding theorem 

I. Introduction 

Decode-and-forward (DE) and compress-and-forward (CE) 
are the two main relaying strategies developed in JT] for the 
three-node relay channel. There have been many attempts to 
generalize them to discrete memoryless networks (DMN). Eor 
example, CE was generalized for DMN in m-il and DE 
was generalized for DMN in Is), Jh). Eor the three-node relay 
channel, the partial-decode-compress-and-forward relaying in 
Theorem 7 in III combines both DE and CE. However, to 
the best of our knowledge, there have been no results that 
generalize this to DMN. There were some relaying strategies 
for general DMN where each relay performs either CE or DE 
0, Q, but not both. 

In this paper, we propose a unified scheme that generalizes 
the partial-decode-compress-and-forward relaying in Theorem 
7 in III to DMN. Our scheme, which we call noisy network 
coding with partial DE (NNC-PDE), simultaneously general¬ 
izes noisy network coding (NNC) by Lim, Kim, El Gamal, 
and Chung a and distributed decode-and-forward (DDE) by 
Lim, Kim, and Kim ||6|. In our scheme, each relay can perform 
both partial DE and CE simultaneously. 

It is not trivial to combine NNC and DDE schemes. In 
NNC, the same long message is sent over multiple blocks. 
In each block, the source sends an independent codeword 
indexed by the message and each relay compresses its received 
channel output sequence and forwards the covering index. 
After the transmission of all blocks, the destination decodes 
the message (uniquely) and the covering indices (nonuniquely) 


simultaneously over all blocks. On the other hand, in the DDE 
scheme, independent messages are sent over multiple blocks 
and information about each message is captured by a set of 
auxiliary covering indices, one per relay. Before starting the 
transmission, the source finds those auxiliary covering indices 
for each message using backward encoding over all blocks. 
In each block, the relay decodes the auxiliary covering index 
intended for itself and forwards it. After the transmission of all 
blocks, the destination decodes the message and the auxiliary 
covering indices sequentially using backward decoding. 

Due to these inherent incompatibility in encoding and de¬ 
coding strategies of NNC and DDE schemes, it is worthwhile 
to consider recent works on short message NNC 0, 13. These 
works differ from i) in that the source sends independent 
messages over blocks and the destination decodes the message 
using sliding window decoding a or backward decoding 
Q, and hence more compatible with DDE scheme. One 
drawback of short message NNC schemes is that they require 
the destination to uniquely decode the covering indices, which 
results in extra constraints. These extra constraints turn out to 
be redundant 0, but when combined with partial DE, it is 
not clear whether similar arguments apply. This motivates us 
to consider a long message at the source and simultaneous 
nonunique decoding at the destination as in 0 for com¬ 
bining NNC and DDE schemes. In our NNC-PDE scheme, 
before starting the transmission, the source finds the auxiliary 
covering indices that carry information about the message 
simultaneously over all blocks (no backward encoding). In 
each block, each relay decodes the auxiliary covering index, 
compresses its received channel output sequence, and forwards 
the decoded and covered indices. After the transmission of 
all blocks, the destination decodes the message uniquely 
and the auxiliary covering indices and the covering indices 
nonuniquely, simultaneously over all blocks. 

The following notations are used throughout the paper. Eor 
two integers i and j, \i : j] denotes the set {i,i + 1,... ,j}. 
Eor a set S of real numbers, 5'[i] denotes {j : j €S,j < i}. 
Eor constants ui,...,Uk and S' C [1 : k], us denotes the 
vector {uj : j € S) and uj denotes u^i-^ where the subscript 
is omitted when i = 1, i.e., - Eor random variables 

Ui,... ,Uk and S C [1 : k], Us and fS are defined similarly. 
Eor sets Ti,..., and S C [1 : k], Tg denotes Ujes 
Tl denotes where the subscript is omitted when i = \. 
lu=v is the indicator function, i.e., it is 1 if m = u and 0 


otherwise. We follow the notion of typicality in IS), H). 

II. Model 

A single-source multicast discrete memoryless network of 
N nodes (A'l,..., A'at,..., consists 

of a set of channel input and output alphabets {Xk,yk) for 
fc G [1 : iV] and a collection of conditional probability mass 
functions p(y[i: 7 v]| 2 ;[i:Ar])- Let node 1 denote the source node 
and let V C [2 : N] denote the set of destination nodes. An 
{R, n) code for the single-source multicast discrete memo¬ 
ryless network consists of message I, uniformly distributed 
over X = [1 : 2"^], encoding function at the source that 
maps / G X to cc" G processing function at node 

fc G [2 : iV] at time z G [1 : n] that maps G yi~^ to 
Xk,i G Xk, and decoding function at destination d G V that 
maps y'2 G y^ to Id G X. The probability of error is defined 
as = P{id 7 ^ I for some d G V) and a rate R is said 
to be achievable if there exists a sequence of (X, n) codes 
such that lim„_>.oo = 0. The capacity is defined as the 
supremum over all achievable rates. 

III. Noisy Network Coding with Partial 
Decode-and-Forward 

The following theorem gives a noisy network coding with 
partial decode-and-forward (NNC-PDF) bound for single¬ 
source multicast discrete memoryless networks, which simul¬ 
taneously generalizes NNC a and DDF i). 

Theorem 1: For a single-source multicast DMN, a rate of 
R is achievable if 

X < min min J(Xi, Vs; Xt<=, Tt<=, fdiFsc) 

dGU S.r:SCTC[2:Ar]\{(;} 

+ I{Xt, Us-, Yt^,Y d\X^, Xtc, , Use) 

- I{Yt-, YtIYtc , X^, V^, U^, Yd) 

- Y, iHUk-,X^, V^, Use[k] |f4, Xk,Yk) + I{Vf,Vse[k])) 

kGSe 

for some p{xi,v^,u^)YlYpi^k\vk)p{yk\xk,Uk,Vk,yk) 
such that Ek^s' HUk-,Yk\Xk,Vk) > Ek&s'HVk;Vs>ik]) + 
I{Uk-,Us'[k],Vs>\Vk) for all C [2 : AT]. 

Remark 1: For N = 3, the NNC-PDF bound falls back to 
Theorem 7 in which is a partial-decode-compress-and- 
forward bound for three node relay networks. 

Remark 2: The NNC-PDF bound recovers NNC 0 and 
DDF a bounds by letting U^ = = 0 and by letting 

p{v[2-.N]) = nfce[ 2 :Ar]P(^fc)’ = Xk, and Tfc = 0 for /c G 
[2 : A^], respectively. 

Remark 3: In the DDF scheme a, the relay nodes, i.e., 
nodes 2,... ,N — 1, send independent codewords. In contrast, 
the NNC-PDF scheme allows arbitrary correlation among 
transmitted codewords from relay nodes. 

IV. Proof 

Our NNC-PDF bound is derived as an application of our 
unified coding approach for network information theory Col, 
mil. Let us briefly present the unified coding framework and 
unified coding theorem ifTOl . ifTTl and then prove Theorem [T] 


A. Unified approach for network information theory 

1) Unified framework: Let us first explain the uni¬ 

fied framework ca, mil for proving the achievability of 
many network information theory problems. An A^-node 
acyclic discrete memoryless network (ADMN) (Xi,..., Xn, 
yi,---,yN,Y\k=iPiyk\y^~^,x^~^)) consists of a set of al¬ 
phabet pairs {Xk,yk), k G [1 : A^] and a collection of 
conditional pmfs fc G [1 : A^]. Here, Yk and 

Xk represent any information that comes into and goes out 
of node k, respectively. In this network, information flows in 
one direction and node operations are sequential. Let n denote 
the number of channel uses. First, Yf- is generated according 
to nr=iP(2/i.i) '^hen node 1 processes X" based on Yf-. 
Next, Yf^ is generated according to YYi^iP{y 2 ,i\xid,yi,i) and 
then node 2 encodes Xf; based on Yff. Similarly, Y^ is 
generated according to Y^^iP{yk A^Y,yY) and node k 
encodes XJ} based on Y^ for fc G [1 : A^]. Clearly, any layered 
network El or noncausal network (without infinite loop) C2 
possibly with noncausal state or side information can be rep¬ 
resented as an ADMN. Furthermore, any strictly causal (usual 
discrete memoryless network with relay functions having one 
sample delay) or causal network (relays without delay ifT^ l 
with blockwise operations can be represented as an ADMN 
by unfolding the network. 

The objective of an ADMN is specified using a target 
joint distribution p*{x^ ,y^), which is shortly denoted as 
p*. The probability of error is defined as Pe^\p*,e) = 
X((Xj”.^],Fj”,^]) ^ where the typical set is 

defined with respect to p*. We say the target distribution 
p* is achievable if there exists a sequence of node pro¬ 
cessing functions Y^ X]^, k = such that 

lim„^.oo xi"^(p*, e) = 0 for any e > 0. 

In the following, we illustrate how the point-to-point chan¬ 
nel coding problem can be represented using an ADMN and 
a target distribution. 

Example 1 : For point-to-point channel coding problem 
with message rate of X, we choose p{yi)p{y2\xi,yi) such 
that H{Yi) = X (corresp. to the message of rate X) and 
p{y2\xi,yi) =p{y2\x\) (corresp. to the channel) and pick p* 
such that X 2 (corresp. to the message estimate at node 2) is 
equal to Yi. Then, Pe\p*, e) for any e > 0 is lower-bounded 
by P{Yf‘ Xf ), and hence achievability of p* implies that 
of rate X. 

2) Unified coding theorem: Let us present the unified 
coding theorem which gives a sufficient condition to achieve 
p* for an ADMN. To do that, we explain the coding parameters 
for the codebook generation and node operation of the unified 
coding scheme. In the unified coding scheme, 1 / covering 
codebooks Ci,..., Cj/ are generated to compress information 
that each node observes and decodes. Let Uj for j G [1 : 12 ] 
denote the alphabet for the codeword symbol of Cj. For 
indexing of codewords, we consider p index sets Xi,..., X^, 
where Cj = [1 : 2"’'^] for some rj > 0 for each j G [1 p]. 
We denote by Fj C [1 : p] the set of indices of X’s associated 
with Cj in a way that each codeword in Cj is indexed by the 



Fig. 1. Node A: E [1 : A^] operates in three steps: 1) simultaneous nonunique 
decoding, 2) simultaneous compression, and 3) symbol-by-symbol mapping. 

vector Itj S Ilier, £i and hence Cj consists of 2" ^'^^3 
codewords, i.e., Cj = {u^{lrj) ■ hj & Ilier Each 
codebook is constructed allowing superposition coding. Let 
Aj C [1 : i/],j G [1 : j/] denote the set of the indices of C’s 
on which Cj is constructed by superposition. 

Node fc G [1 : A^] operates according to the following three 
steps as illustrated in Fig. [T] 

• Simultaneous nonunique decoding: After receiving y^, 
node k decodes some covering codewords of previous 
nodes simultaneously, where some are decoded uniquely 
and the others are decoded non-uniquely. We denote by 
Dk L [1 : z/] and C [1 : i/] the sets of the indices 
of C’s whose codewords are decoded uniquely and non- 
uniquely, respectively, at node k. 

• Simultaneous compression: After decoding, node k finds 

covering codewords simultaneously according to a condi¬ 
tional pmf 2/fc) that carry some information 

about received channel output sequence and uniquely 
decoded codewords where Wk C [1 : z/] denotes the 
set of the indices of C’s used for compression. 

• Symbol-by-symbol mapping: After decoding and com¬ 

pression, node k generates x'^ by a symbol-by-symbol 
mapping from uniquely decoded codewords rz^^, covered 
codewords and received channel output sequence 

Let XkiuDkjUWkjVk) denote the function used for 
symbol-by-symbol mapping. 

More rigorous explanations for the codebook generation and 
node operation of the unified coding scheme are provided in 

nni. 

In summary, our scheme requires the following set oj of 
coding parameters, where some constraints are added to make 
the aforementioned codebook generation and node operation 
proper: 

1) positive integers y, and 1 / 

2) alphabets Uj,j G [1 : z^] 

3) /i-rate tuple (ri,... ,r^) 

4) sets kLfe C [1 : z/] \ W’^-^,Dk C C \ 

Dk, Ej C [1 : y], and Aj C [1 : z/] for k G [1 : N] and 
j G [1 : z/] that satisfy 

A-1 Twk \rDfc’s are disjoint, 

A-2 C Lj and j' < j if j' G Aj, 

A-3 Awk Q WkUDk, Ask Q DkUBk, and A^k L Dk- 

5) a set of conditional pmfs p{uWk\uDk,yk) and 

functions XkiuDk,uWk,yk) for fc G [1 : 

N] such that p{x[i:N],y[i-.N]) induced by 

Ilk=iPiyk\y'"~\x'^-^)p{uwk\uDk, yk)l Xk=Xk{uDk,'U-Wk,Vk) 

is the same as the target distribution y[i:Ar])- 


The following theorem gives a sufficient condition for 
achievability using the aforementioned unified coding scheme. 

Theorem 2 (Unified coding theorem m, SIS): For an 
A^-node ADMN, p* is achievable if there exists uj G Cl such 
that for 1 < fc < A^ 

UskU]us^k ’ Yk\UA,) ( 1 ) 

jeSk O^Sk 

m ; UTk U]uDk, Yk I Ua, ) (2) 

jGTk J(^Tk 

for all Sk L Dk U Bk such that Sk H Dk I 0 and for all Tk C 
Wk such that fk 7 ^ 0 , where Dk = Tok, Bk = TBk \ CDk, 
Wk = Twk \ ^Dk, 

‘S'fe — {j ■ j G DkU Bk, Fj n Sk 0}, 

Tk = {j ■■ j e Wk,T, n [Tk U Dk)^ = 0}. 

Remark 4: ([T]) and (|2l) for fc G [1 : A^] are the conditions for 
successful simultaneous nonunique decoding and simultaneous 
compression, respectively, at node fc. 

B. Proof of Theorem Q] 

To derive the NNC-PDF bound in Theorem [H we first 
represent our network model as an ADMN and p* and then 
apply the unified coding theorem for a specific choice of 
coding parameter set w. 

1) Corresponding ADMN and p* for our problem: We note 
that our network model itself cannot be represented as an 
ADMN. By assuming a block-wise operation at each node, 
however, the network can be unfolded and represented as an 
ADMN. 

Achievability uses B transmission blockfl each consisting 
of rz channel uses. Let and for fc G [1 : A^] and 
b G [1 '■ B] denote the channel output and channel input 
sequences, respectively, at node fc at block b. At the end of 
block b—1, where 6 G [1 : B], node fc G [1 : W] encodes what 
to transmit in block b, i.e., Xfj^, using previously received 
channel outputs up to block 6—1, i.e., Using this 

block-wise operation at each node, we unfold the network. 
In the unfolded network, we have [B -1- 1)N nodes. The 
operation of node (fc, 6),fc G [1 : A^],6 G [1 : S] corresponds 
to that of node fc of the original network transmitting in block 
b based on the received channel outputs up to block 6—1 
and the operation of node [d, B + l),d G D corresponds 
to that of node d of the original network that estimates 
the message based on the received channel outputs up to 
block B. Let and denote the channel output 

and channel input at node (fc,6) of the unfolded network, 
respectively. A message generated at the source is regarded 
as the channel output at node (1,1), i.e., = M such 

that H{M) = BR, and the message estimate at destination 
d G T> is regarded as the channel input at node (d, B + 1), 
i.e., = Wl- To reflect the fact that node (fc,6 + 1) 

*For initialization, we use additional (N — 1)^ blocks before the transmis- 
sion of B blocks, which will be explained later. 













is originally the same node as node (fc, b), we assume 
that node {k,b) has an orthogonal link of sufficiently 
large rate to node {k,b + 1). Hence, for A: G [1 : TV] 
and b G [1 : B], we let and let 

n(^i, ,,unf ,^unf _unf 'i _ 

PYk\Y^l,k-^,x^l,fJ■^iyk,b\y[^^■■k-l],b,X[l:N],b) where 

^ (xk,b,Zk,b) for Xk,b G Xk and Zk,b G Zk,b for 
some Zk,b with arbitrarily large cardinality. 

We assume a target joint distribution 

P*(a^[u^],[i:B+i],y[u^].[i:B+i]) ^^h that X-J+i = for 

all d gV. Note that the achievability of p* for the unfolded 
network implies the achievability of rate R for the original 
network. 

2) Application of unified coding theorem: Now, let us 
choose w G H to obtain the NNC-PDF bound. In our NNC- 
PDF scheme, before starting the transmission, the source finds 
the auxiliary covering indices that carry information about 
the message simultaneously over all blocks. At each block, 
node k decodes the auxiliary covering index intended for it 
and finds the covering index that carries information about 
its received channel output. After all transmission, destination 
node decodes the message uniquely and the auxiliary covering 
indices and the covering indices nonuniquely, simultaneously 
over all blocks. This operation can be translated to the follow¬ 
ing parameter set for unified coding. 

Fix PXi,Vf^ ,UfY{k=2PXk\VkPYk\Xk,Uk,Vk,Yk- ^ 

2BN - B + N wd V = ABN - ?,B - N + 2. Consider 

a /i-rate tuple {ro,ri^b,rk^b': b G [1 : B],b' G 
[0,5], 6" G [0,5 — l],fc G [2 : A^]). For notational conve¬ 
nience, let us index the codebook C by the auxiliary random 
variable used for its generation, i.e., if a codebook consists 
of m"(1 ), ... generated conditionally independently 

according to YYi^iP{ui\vi) for some r > 0 and p(u\v), we 
denote the codebook by Cu- In addition, we index the index 
set C in the following way: Ci„ = [1 : = [1 : 

= [1 : 2”’’'=.o'], and = [1 : 2”’'^.'>"] for 

& G [1 : 5], 6' G [0,5], 6" G [0,5-1], and fc G [2 : A^]. 
The remaining coding parameters associated with each node 
are given as follows: 

. Node (1,1): 

FFi,i = {U^,Xi^b,Uk,b,Vk,b,k& [2 : AT],& G [1 : 5]} 
F(7o = {^o}; Fxi,6 = {Iq, hfi, l2,b-l, ■ ■ ■ , lN,b-l} 

Fc/fc.i = {lk,b,lk,b-i}, = {h,b-i} 

= {Ffc.b, fc G [2 : AT]}, = {14,&} 

p(IFi,i|5i,i,2/]*f) = 

■ n PXi,Vf ,Uf {xi,b,V2,b ■ ■ ■VN,b,U2,b, ■ ■ ■ ,UN,b) 
be[l-.B] 

. Node (A:, I), A: G [2 : AT]: 

DkA={Vk,i}, Wk,i={Xk,i} 

Fxfc.i = {4,0,4,ol: ^Xk,i = {Ffe,i} 

p{Wk.i\Dk,i,ykp) = px,^\v^ {xk,i 4fe,i) 


. Node (1,6), 6 G [2 : 5]: 

Di,b = W^i.i 

. Node (A:,6), A: G [2 : AT],6 G [2 : 5]: 

Dk,b = U 5^1 U {Uk,b-i, Vk,b} 

Wk,b = {Ffe,b-i, ATfe,b} 

~ 4,b-i, 4,f>-2,4,f>-2} 

Fxfc,6 = {/fc,b-i,/{,t,_i} 

^Yk b-1 ~ {-^fc.b-1, C^fc.b-1, Vfe,b-l}, Xxk,b = {Ffc.bj 

p{Wk,b\Dk,b,yZ') 

~ PYfc|Xfc,;7fe,t4,Yfc(yT;,b-l|2;fc,b-l, Uk,b-1, Xk,b-1, 2/fc,b-l) 

■ PXk\Vk{xk,b\xk,b) 

• Node {d, B + 1), d G V 

5d,B+i = W'i'u 5f U {5o} 

5d,s-i-i = {Xi^b,Uk,b,Vk,b,Xk,b,Yk,b, 

kG [2: AT]\{d},6G [1 :5-l]} 

For A: G [1 : AT] and 6 G [1 : 5], we let Xjl^^ = 
(yk,ii:b-i],W^,Dl). For d G D, let = Uo- Before 

initiating the transmission of 5 blocks, each chosen at 
the source is transmitted to node A; G [2 : AT] using multi-hop 
scheme as in Q, and this requires additional (AT — 1)^ blocks. 
Note the actual rate „g_)_4Gv-i)^ ^e arbitrarily close to R 
as 5 —c». As a result of this initialization step, we can let 

= Vfc,i for A: G [2 : AT]. 

Remark 5: In the above choice of a; G H, 4 corresponds 
to the message index and {lk,b : A; G [2 : AT], 6 G [0 : 5]} 
corresponds to the set of auxiliary covering indices that carry 
information about the message. These indices are chosen 
simultaneously at node (1,1) of the unfolded network, i.e., 
the source before starting the transmission. Node (A;, 6) for 
A: G [2 : AT], 6 G [2 : 5] of the unfolded network, i.e., node 
k at the end of block 6—1, decodes lk,b-i and finds the 
covering index 4 b-i carries information about 
At node (d, 5 -f 1) for d gV of the unfolded network, i.e., 
node d at the end of block 5, simultaneously decodes the 
message (uniquely) and the auxiliary covering indices and the 
covering indices (nonuniquely). 

To prove Theorem [T| we use the following lemma, whose 
proof is given in ifTOll . 

Lemma 1: Consider w G O. For Sk Q Dk U Bk such that 
Sk n Dk 0 and 24 C Wk such that 74 f- 0, the decoding 
and compression bounds, i.e., O and (|2]i, in Theorem |2] are 
satisfied if 

E 4 < E b-lus-, n|5A,) (3) 

ieSfe NS'k 

E 4 > E ^(^4 (4) 

IgA iGT^ 



for some 5^ C Sk such that Aj C [Sk \ «S'^)[j] U for all 
jGSk\ and Tk C T^. 

Now, we are ready to apply Theorem|2]to prove Theorem[T] 
Let ri,b = ri, rk,B = 0, rk,b' = ffc, and r'^ y = r',^ for some 
T'l > 0, rfc > 0, and 7’^ > 0 for b G [1 : B], 6' S [0 : i? — 1], 
and k G [2 : iV]. For each node in the unfolded network, let 
us derive the decoding and compression bounds i.e., O and 
0, respectively. First, for compression at node (1,1), note 
that ILi^i = {lo,li^b,lk,b'G [1 : B],b' G [0 : B],k G 
[2 : N]}. By applying Lemma [T] and using the following 
blockwise i.i.d. property p(xi,[i:B],'y[2:7V],[us], wpiTV],[us]) = 
ribefiiB] ^[2:tv],b,we Can show that 

the condition for compression is satisfied if 

ro > BR 

I{yk',Vs[k]) + ^ I{Uk; Us[k]:Vs\Vk) 
kGS kGS kGS 

ri+ Y. E 

fcg[2:Ar] fee[2:Ar] 

+ ^ IiUk-,U^-\V[2:N],X,\Vk) 

kGl2:N] 

for all S' C [2 : N], 

Next, consider the decoding and compression bounds for 
node (fc, 1), fc S [2 : N], Since = Dk^i, the bound for de¬ 
coding becomes inactive. Furthermore, it can be easily shown 
that the bound for compression is also inactive. Similarly, for 
node (1,6), 6 G [2 : B], since = Di b, the bound for 
decoding becomes inactive. 

Now, consider the decoding and compression bounds at 
node (k,b),k G [2 : iV],6 G [2 : B], Since Dk^b = 
Wk,b-i U Dk,b-i U {lk,b-i} and Yi^f contains Wk,b-i and 
Dk^b-i, we only need to consider Sk,b = From the 

following blockwise i.i.d. property 

F(a;[l: AT], ,l’[2:Af].[l:B-l],U[2:Ar], [1:5-1],y[l: Af], y[2:Af],[l:B-l]) 

= H {PXi.Vf,Ui'i^i,b,'l’l2:N],b,Ul2:N],b) 
bG[l:B-l] 

■ n F^fc|Vfc(a;fe,bkfc.b) ■PY[i,;v]|X[i^„](y[l:Ar],bk[l:Ar].b) 
fcg[2:Ar] 

fcG[2:Ar] 

(5) 

the bound for decoding is given as < I{Uk;Yk\Xk,Vk). 
Also, we have Wk,b = {^fcb-i}- From the blockwise i.i.d. 
property shown in @, the bound for compression is given as 
r'^ > I(Yk;Yk\Xk,Uk,Vk). 

Lastly, consider the decoding bound at node {d, B + l),d G 
V. Since Dd,B+i = Wd,B'JDd,Bki{lo}, where Wd,B'JDd,B = 
{ld,bJd,b ■ b G [0 : B - 1]}, and contains Wd,B and 

Dd,B, we only need to consider Sd,B+i Q {lo, h,b, lk,b'J'k,b' ■ 

2We can show rigorously that bounds corresponding to Sk b such that 
Sk b (^k b—i U Dk,b—i) 0 become redundant, but we omit the proof 
because it is trivial. 


6 G [1 : B - 1], 6' G [0 : B - 1], fc e [2 : iV] \ {d}} such 
that Iq G Sd,B+i- From Lemma [T] and using the blockwise 
i.i.d. property shown in Q, we can show that the bound for 
decoding is satisfied if 


ro<{B- 1) 

X min 

S,T-.SCTC[2:N]\{d} 


(E ^S<=, Us<=,YTc,XTc,Yd) 

kGS 


+ HXi; Us'= ,Yt<= , Xt<= ,Yd\V[2:N]) 

+ YnXk; XT[k],X,,V[2 -.n], Us^ , Yt^ , ,Yd\Vk) 

k€T 


+ E ^i^k;Usik],X^, Vl2:N], Us'= ,Yt'= ,Yd\Vk) 

kGS 


+ Y IiYk;YTik],YT^,X^, V[2..N],U[2..N],Yd\Uk,Vk,Xk) 
k^T 

-(E^fc + E^fe)“^i) ^ E 

kGS kGT fcG[2:Ar] 


By performing Fourier-Motzkin elimination and taking 
B ^ oo, p* is shown to be achievable if the condition in 
Thoerem[T]is satisfied, and hence Theorem [T] is proved. 
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